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Abstract 

Product LDPC codes take advantage of LDPC decoding algorithms and the high minimum distance of product 
codes. We propose to add suitable interleavers to improve the waterfall performance of LDPC decoding. Interleaving 
also reduces the number of low weight codewords, that gives a further advantage in the error floor region. 
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I. Introduction 



c/2 , The current scenario of soft-input soft-output (SISO) decoded error correcting codes is characterized by a huge 

number of different options, each of them with its own endowment of merits and limitations. Speaking in terms 
of wide families of codes, classical parallel concatenated turbo codes [1] (together with their serial counterpart 

> 

' [2]) generally exhibit easy encoding but rather complex decoding (based on the BCJR algorithm [3]). On the 

, contrary, low-density parity-check (LDPC) codes [4] have low decoding complexity, thanks to iterative algorithms 



working on the Tanner graph, but their encoding complexity can be quadratic in the code length [5]. Product codes 
often represent an important tradeoff, as they can exploit a high degree of parallelization both in the encoding 
and decoding stages. Moreover, they are able to guarantee the value of the minimum distance, that makes them 
particularly attractive in applications, like optical communications, that require extremely low error rates. Product 

•rH . 

codes are often designed by using linear block codes as component codes and can be iteratively decoded by using 
a modified Chase algorithm [6], able to provide very good performance especially for high code rate applications. 
Product codes based on convolutional codes have also been proposed [7]. Their component codes exhibit a time 
invariant trellis structure, so they may be more favorable for implementation than linear block product codes. On 
the other hand, they require the inttoduction of interleaving to improve performance and possibly preserve the 
minimum distance properties. 

Much less literature exists, at the authors' knowledge, on the combination of LDPC codes and product codes. 
Actually, it is well known that long powerful LDPC codes can be constructed by superposition (see [8] and the 
references therein). Since the product code can be seen as a special case of superposition, product coding is indeed an 
effective method to construct irregular LDPC codes [9]. Till now, however, only a few papers have investigated the 
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features of product LDPC codes. In [10], it was shown that they can outperform other LDPC codes constructions 
in the region of low signal-to-noise ratios. In [11], an algorithm was proposed to construct product codes with 
minimal parity-check matrices, that are expected to improve performance in the waterfall region by increasing the 
girth. However, such algorithm does not alter the structure of the product code, that, instead, may offer further 
margins for improving performance. As we show in this letter, such result can be achieved by introducing an 
interleaver that preserves the multiplicative effect of the product code on the minimum distance. 

Regarding the structure of the component codes, in [9] an Euclidean geometry LDPC code is combined with a 
single parity-check (SPC) code. In [12], the proposed product code consists of an LDPC code designed through 
the progressive edge growth (PEG) algorithm [13], combined with a Reed-Solomon code, and reveals to be a very 
efficient solution for error-resilient image transmission. In all cases, a very important issue concerns the need to 
satisfy the so-called row-column (RC) constraint of the parity-check matrix, that ensures the Tanner graph has girth 
at least six. If the component codes are both LDPC codes, tighter bounds on the length of local cycles in the 
product code can also be derived [11]. 

Classical direct product codes are obtained by placing the information bits in an encoding matrix (that will be 
better described in Section II) and then encoded (first by rows and then by columns, or vice versa). No further 
interleaving is usually applied. On the contrary, in [7], the effect of different interleavers on the performance 
of convolutional product codes was investigated, showing that such further randomization can yield significant 
improvements. 

Inspired by the approach in [7], in this letter we extend the application of interleaving to the encoding matrix 
of product LDPC codes. As component codes we use very simple multiple serially concatenated multiple parity- 
check (M-SC-MPC) codes, that we have recently introduced [14]. M-SC-MPC codes have girth at least six and 
their minimum distance is known or can be easily evaluated through exhaustive enumeration. We apply a suitably 
designed interleaver that preserves the minimum distance of the product code and satisfies the RC constraint. We 
show that the new solution provides a significant gain in the waterfall region with respect to the non-interleaved 
solution, that is the main advantage of the proposed scheme. In addition, interleaving can reduce the multiplicity 
of low weight codewords, so producing an advantage also in the error floor region. 

The letter is organized as follows: Section II recalls the definition and properties of product LDPC codes; Section 
III introduces interleaved product LDPC codes; Section IV provides some design examples and Section V concludes 
the letter. 

II. Product LDPC Codes 

We focus on the simplest form of product codes, that are bi-dimensional direct product codes. In this case, the 
product code results from two component codes working on the two dimensions of a rectangular matrix like that 
reported in Figure 1. We denote by (n a ,k a ,r a ) and (nb,kb,rb) the length, dimension and redundancy of the two 
component codes. The information bits are written in the top-left kb x k a matrix (marked as "Information bits" 
in the figure) in row-wise order, from top left to bottom right. When the top-left matrix is filled, the first code, 
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Fig. 1. Encoding matrix for a direct product code. 



called row component code, acts on its rows, producing a set of kbr a checks, that fill the light grey rectangular 
region marked as "Checks a". Then, the second code, called column component code, acts on all n a columns, so 
producing k a rb checks on the information symbols and further r a rb checks on checks. The whole matrix has the 
meaning of an encoding matrix. If the minimum distances of the two component codes are d a and db, respectively, 
the product code has minimum distance d p = d a db- The direct product code would be exactly the same if the 
column component code is applied before the row component code. 

Several types of component codes can be used. SPC codes are often adopted because of their simplicity, but they 
can yield severe constraints on the overall code length and rate. Better results can be obtained with product codes 
based on Hamming components, that can achieve very good performance under SISO iterative decoding [15]. 

A parity-check matrix for the direct product code can be obtained as follows. Let us suppose that the component 
codes have parity-check matrices H a and H^, and that h,*^ represents the j-th column of Hj, i = a, b. A valid 
parity-check matrix for the product code having these components is [16]: 



H„ 



H 
H 



pi 



P 2 



(1) 



where H p i has size r a rib x n a rib, and H P 2 has size r\,n a x n a rib. H p i is the Kronecker product of an rib x rib 
identity matrix and H a , that is, I g3 H a . This results in a block-diagonal matrix formed by rib copies of H a , i.e., 

H a 
H„ ••• 



H 



pi 



(2) 



H a 

where represents an r a x n a null matrix. H P 2 is instead a single row of rib blocks. The z-th of these blocks has 
n a copies of the i-th column of Hf, (hh i, i € [l;n&]) along the main diagonal, while its other symbols are null. 
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Hp is redundant, since it includes two sets of parity-check constraints representing checks on checks calculated 
through the two component codes. For this reason, H p cannot have full rank. When the component codes are 
in systematic form, as in our case, all redundancy bits are positioned at the end of each codeword, and a full 
rank parity-check matrix for the product code can be obtained by eliminating the last r a r b rows from H p i or, 
equivalently, from H p2 . In the following, we will choose to eliminate the last r a r b rows from H p i, such that it 
only contains n b — r b = k b copies of H a . An alternative form for H p2 can be obtained if we rearrange its rows 
by taking, in order, those at the following positions: 1, r b + 1, 2r b + 1, . . ., (n a — 1) r b + 1, 2, r b + 2, 2r b + 2, 
. . ., (n a — 1) r b + 2, . . ., r b , 2r b , 3r b , . . ., n a r b . In this case, H p2 can be written as H b ® I, that is, the Kronecker 
product of Hb and an n a x n a identity matrix. So, according to [17], we have: 



If we suppose that the density of symbol 1 in H a and H b is S a and 5 b , respectively, it is easy to prove that 
the density of H p i is 5 a /n b , while that of H p2 is 5 b /n a . So, even starting from two component codes not having 
sparse parity-check matrices, the resulting product code can be an LDPC code. 

Furthermore, it is also possible to verify that the matrix (1) is free of length-4 cycles, provided that the same 
property holds for the component matrices, H a and H b . More precisely, it is proved in [11] that the girth in H p 
is lower bounded by min {g a , g b , 8}, where g a and g b are the girths in H a and H b , respectively. So, the codes 
obtained as bi-dimensional product codes can be effectively decoded by means of LDPC decoding algorithms, like 
the well-known Sum-Product Algorithm (SPA) [18], acting on the code Tanner graph. Compared to classical turbo 
product code decoding techniques, that exploit iterative decoding of the component codes, SPA achieves the same 
or better performance, but with lower complexity [16]. 



A common solution to improve the convergence of iterative soft-decision decoding algorithms is to insert an 
interleaver between two (or more) concatenated component codes. Interleaving is crucial in the design of turbo 
codes, and it has also been exploited in the design of turbo product codes based on convolutional codes [7]. 

We are interested in the use of column-interleavers, that are able to preserve the minimum distance of the product 
code by interleaving only one of the two component codes. In other terms, a column-interleaver only permutes the 
elements within each row of the encoding matrix. Since the interleaver acts after row encoding, the effect of the 
row component code is unaltered and, before column encoding, at least d a columns contain a symbol 1. It follows 
that the code minimum distance remains d p = d a d b [7]. 

A valid parity-check matrix for the column-interleaved product code can be obtained starting from (3) and 
considering that: 




I®H, 



O 



(3) 



H 6 (g>I 



III. Interleaved Product LDPC Codes 



Hp 2 = H h <g> I 

= [h M |h 6 , 2 |...|h M J<g)I 

= [h M <g> I|h 6i2 <g> I| . . . |h Ml) <g> I] . 



(4) 
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Let us introduce a vectorial Kronecker product operator (®) that works column-wise. Given a x x y matrix A and 
a v x wy matrix B, C = A<g>B is a xv x wy matrix. The i-ih group of w columns of C, i = 1, . . . , y, is obtained 
by starting from the i-th column of A and multiplying each element by the matrix formed by the i-th group of w 
columns of B. By using this operator, (4) can be rewritten as follows: 

H p2 = H 6 ® I = H 6 ®[I|I|...|I], (5) 

where the right operand matrix is a row of rib identity matrices, each with size n a . By the explicit computation 
of (5), it can be shown that H p2 contains n a copies of each copy having its elements spread within H p2 . In 
fact, each element of Hf, is replaced by an n a x n a identity matrix, according to (5), so all the elements of H;, are 
repeated n a times within H p2 . More in detail, a first copy of Hf, involves the codeword bits at positions 1, n a + 1, 
2n a + 1, . . . , (rib — l)n a + 1; a second copy of H;, involves the codeword bits at position 2, n a + 2, 2n a + 2, 
(rib — l)«a + 2 and so on. 

Let us consider the array P = [Pi|P 2 | ... \P nb ] of rib permutation matrices, each with size n a . The permutation 
matrix Pj, j 6 [1; njj, can be described through the set IP = ^tt{, tt^, . . . , 7r^ j, in which tt{ is the column index 
of the symbol 1 at row i. It follows from the definition of permutation matrix that IF has no duplicate elements. 

Theorem III.l Given a product code with parity-check matrix H p in the form (3), the application of a column- 



interleaver transforms H p into: 

I®H Q 
H b ® P 

where P is the array of permutations applied to the rib rows of the encoding matrix. 



(6) 



Proof: As described above, a column-interleaver only permutes the column component code. Since H pi = 
I (g> H a describes the row component code, it remains unchanged after interleaving. By replacing H p2 with Hp 2 = 
H;,® P, the first copy of Hb within Hp 2 involves the codeword bits at positions 7r}, n a + t^\, 2n a + 7rf , 
(rib — l)^a + tt™ 6 ; the second copy of H& within Hp 2 involves the codeword bits at positions 7r 2 , n a + 7r|, 
2n a + 7r|, . . . , (rib — l)^a + tt 2 b an d so on - The indexes of the codeword bits involved in each copy of H^ within 
Hp 2 are all distinct, since nf, takes values in the range [l;n n ]. Furthermore, all codeword bits involved in 

the same copy of Hfc come from different rows of the encoding matrix. More precisely, the m-th codeword bit 
involved in the q-th copy of H& is at position (m — l)n a + it™. Since this value is between (m — l)n a + 1 and mn a , 
the bit comes from the m-th row of the encoding matrix. Finally, for the properties of permutation matrices, each 
IP = 1 7i^, 7r^, . . . , 7r£ o j, j G [l;n&], does not contain duplicate elements; so, each codeword bit is only involved 
in one copy of H^. This proves that Hp 3 describes the product code after application of the column-interleaver. ■ 

A tutorial example of product code and its column-interleaved version is shown in Fig. 2. 

Theorem III. 1 establishes a method for the design of the parity-check matrix of a product code in which a column- 
interleaver is applied. We will denote such product codes as interleaved product codes in the following. Since we 
are interested in product codes that are also LDPC codes, to be decoded through LDPC decoding algorithms, it is 
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Fig. 2. Example of product code and its column-interleaved version. The component codes are both SPC(4, 3). The applied permutations 
are described by II 1 = {1, 2, 3, 4} , IT 2 = {2, 1, 3, 4} , IT 3 = {3, 1, 4, 2} , IT 4 = {2, 3, 4, 1}. H p i is shown before eliminating the last row 
(required to have a full rank parity-check matrix). 



important that the corresponding Tanner graph is free of short cycles. To this purpose, we can extend the results 
obtained in [11] as follows. 

Theorem III.2 The parity-check matrix of an interleaved product code, , in the form (6), has local cycles with 
length > min {g a , gj,, 8}, where g a and gi, are the girths in H a and Hb, respectively. 

Proof: As in [11], we define the number of connections between two matrices with equal size as the number 
of columns in which both matrices have at least a symbol 1. Within the parity-check matrix of a product code, 
it can be observed that each copy of H a has only one connection with any copy of Hb [11]. More precisely, we 
observe that, within H p in the form (1), the z-th column of each copy of H a is connected only with the i-th copy 
of Due to column-interleaving, within H£\ having the form (6), the i-th column of the j-th copy of H a is 
connected with the 7r|-th copy of H;,. Since IP = |ttJ, 71^, . . . , 7r^ a j does not contain duplicate elements, the j-th 
copy of H a , Mj 6 [1; Ufe], has only one connection with each copy of Hft. So, the same arguments used in [11] for 
a direct product code apply, and this proves the theorem. ■ 

Based on Theorem III. 2, the proposed class of interleaved product codes can be seen as LDPC codes with Tanner 
graphs suitable for the application of decoding algorithms based on belief propagation. 

An important task is to design the array of permutation matrices P in such a way as to have a Tanner graph 



December 6, 201 1 



DRAFT 



7 



with good properties for decoding. To this goal, we have developed two modified versions of the PEG algorithm 
[13]. Both of them aim at selecting, for an interleaved product code, an array of permutation matrices P which 
maximizes the length of local cycles. The array of permutation matrices P, so designed, is then used to obtain 
Hp 2 = Hb® P. The original PEG algorithm has been modified in order to: 

• insert edges only in those n a x n a blocks of Hp 2 that correspond to a symbol 1 in H^; 

• verify the permutation matrix constraint by inserting only a symbol 1 in any row and column of each n a x n a 
block; 

• apply the vectorial Kronecker product, so that the same permutation matrix appears in all blocks along each 
column of Hp 2 . 

This allows to obtain a matrix Hp 2 that, together with H p i = I <g> H a as in (6), forms a valid parity-check matrix 
for the interleaved product code. 

The two versions of the modified PEG algorithm differ in the type of permutation matrices they use. The 
first version only uses circulant permutation matrices. This further constraint reduces the margin for local cycles 
optimization but produces a structured H^. As well known, a structured matrix is advantageous in regard to 
the hardware implementation of encoders and decoders. The second version instead uses general permutation 
matrices. This choice increases the randomization level in Hp 3 and provides further margins for optimization, 
but its implementation in hardware may be more complex than for structured matrices. 

IV. Design Examples 

We provide some design examples of product LDPC codes and their column-interleaved versions by focusing on 
two values of code rate, namely, R = 2/3 and R = 3/4. For the case of R = 2/3, we have used, for both components 
of the product code, an M-SC-MPC code with M = 2 and r 3 = [9, 10] [14]. It has length n a = n b = 100 and 
dimension k a = kb = 81. The parity-check matrix of each component code is in lower triangular form and encoding 
is systematic, with the r a = r& = 19 redundancy bits in the rightmost part of each codeword. Through an exhaustive 
search, the minimum distance d = 4 has been found. Its corresponding multiplicity is M 4 = 2025. 

Similarly, for R = 3/4, we have used as components two identical M-SC-MPC codes with M = 2, rj = [13, 14], 
n a = nb = 196 and k a = kb — 169. An exhaustive search has reported that the minimum distance is d = 4 and its 
multiplicity is M 4 = 8281. 

For both values of the code rate, we have designed a product code with parity-check matrix in the form (1). 
These two product codes are denoted as PC in the following. They have (n,k) — (10000,6561) and (n,k) = 
(38416, 28561), respectively. Moreover, we have designed two column-interleaved product codes for each value of 
code rate, by applying the two modified versions of the PEG algorithm described in the previous section. Obviously, 
they have exactly the same length and rate as their corresponding product codes, but their parity-check matrices 
are different. The first interleaved product code, denoted as iPC-CP, has been designed trough the modified PEG 
algorithm with the constraint of using only circulant permutation matrices. The second interleaved product code, 
denoted as iPC-RP, has been obtained through the modified PEG algorithm that uses generic permutation matrices. 
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Fig. 3. (a) BER and (b) FER for (10000, 6561) product and interleaved product codes. 



The performance of the considered codes has been assessed by simulating Binary Phase Shift Keying transmission 
over the Additive White Gaussian Noise channel. LDPC decoding has been performed through the SPA with Log- 
Likelihood Ratios. For each value of the energy per bit to noise power spectral density ratio (Eb/N ), a value of 
Bit Error Rate (BER) and Frame Error Rate (FER) has been estimated through a Montecarlo simulation, waiting 
for the occurrence of a sufficiently high number of erred frames, in order to reach a satisfactory confidence level. 
The union bound for the product code, noted as PC UB, has been used as a reference. 

Fig. 3 shows the simulation results for codes with rate 2/3. We observe that, in this case, the iPC-CP code 
achieves an improvement in coding gain of about 0.2 dB with respect to the product code. The iPC-RP code 
outperforms the iPC-CP code, and it is able to reach a significant improvement, by more than 1 dB, with respect 
to the product code. Another interesting remark is that the curves for the iPC-RP code intersect the PC UB curves. 

We conjecture that such improvement is due to a reduction in the multiplicity of low weight codewords. The 
product code, in fact, has a rather high number of minimum weight codewords, that is, M 4 = 2025 2 for the present 
case. The effect of column-interleaving is to reduce such multiplicity, particularly for the iPC-RP code, that has 
been designed with no constraint on the permutation matrices. 

To verify this conjecture, we have considered the simple case of an (n, k) = (144, 25) product code obtained 
by using, as component codes, two identical M-SC-MPC codes with M = 2 and rj = [3,4], having length 
n a = rib = 12 and dimension k a = kb = 5. Being very small, these codes permit us to analyze the whole weight 
spectrum of the product code and its interleaved versions. The first terms of the weight spectra are reported in Table 
I. Though referred to small codes, the results show that interleaving reduces the multiplicity of minimum weight 
codewords (it passes from 64 to 40 for both the interleaved codes). We also notice, for the interleaved codes, the 
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appearance of weights that were absent in the product code. Despite this, we observe that the multiplicities of the 
lowest weights for the interleaved codes are generally lower than those for the direct product code. This effect, that 
is similar to the spectral thinning occurring in turbo codes [19], is most evident for the iPC-RP code. 

TABLE I 

First terms of the weight spectrum for a (144, 25) product LDPC code and its interleaved versions 



weight 


PC 


iPC-CP 


iPC-RP 


16 


64 


40 


40 


20 




8 


6 


22 




2 




24 


246 


143 


116 


26 




23 


24 


28 


504 


317 


330 


30 


392 


244 


211 


32 


1262 


831 


719 



The advantage of interleaving is even more evident for longer codes, with rate 3/4, whose simulated performance 
is shown in Fig. 4. In this case, the multiplicity of low weight codewords in the direct product code is even higher, 
and the advantage due to the PEG-based random interleaver more remarkable. Interleaving based on circulant 
matrices gives an improvement of about 0.2 dB with respect to the classical product code. By using an interleaver 
based on generic permutation matrices, the gain exceeds 1 dB and, differently from the code with rate 2/3, no 
error floor effect is observed in the explored region of Eb /N values. Obviously, as interleaving does not increase 
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Fig. 5. Performance comparison, for R = 3/4, between the interleaved product codes and conventional, QC and PEG, LDPC codes. 

the value of the minimum distance, for high signal-to-noise ratio the error rate curves for direct and interleaved 
product codes must assume the same slope. However, the spectral thinning effect of interleaving determines the 
slope change at significantly smaller error rate values. 

Finally, in order to further assess the performance of the proposed class of codes, we have compared the obtained 
error rate curves with those of structured and unstructured LDPC codes, not in the form of product codes. An example 
is shown in Fig. 5 for R = 3/4. The structured code is Quasi-Cyclic (QC), and has been obtained by extending 
to length n = 38400 the design approach used for the rate 3/4 "B" code of the IEEE 802.16e standard [20]. The 
unstructured code, instead, has exactly the same parameters of the rate 3/4 product code, and has been designed 
through the PEG algorithm. Also the Shannon limit has been plotted as a reference. Though all codes exhibit a gap 
from the best result theoretically achievable, their performance is very similar. The BER curve of the interleaved 
product LDPC code is between those of the PEG code (that achieves the best performance) and the QC code (that 
shows good waterfall behavior, but also the appearance of an error floor effect). Thus, it is confirmed that the 
interleaved product LDPC codes, based on very simple M-SC-MPC code components, do not suffer a performance 
loss with respect to other state-of-the-art LDPC design solutions. This is even more evident if we consider that 
some margin for further improving the performance of the proposed class of interleaved product codes may exist, 
because of the degrees of freedom in the constrained random behavior of the PEG algorithm. 

V. Conclusion 

We have shown that interleaved product LDPC codes can have very good performance both in the error floor 
region, where they benefit by a large (and guaranteed) minimum distance value, and in the waterfall region, through 
the design of suitable column-interleavers. We have proposed two different versions of a modified PEG algorithm for 
the design of column-interleavers: the first one uses circulant permutation matrices while the second one exploits 
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generic permutation matrices. The first version preserves the structured nature of the parity-check matrix that, 
instead, is lost with the second version. As a counterpart, the use of generic permutation matrices gives the best 
performance, mostly because of the spectral thinning effect. 

We wish to stress that the column-interleaver design is not critical, in the sense that, following the proposed 
procedure, many different permutations can be found with similar performance. Although interleaving can be 
applied to product LDPC codes of any length and rate, our simulations show that the coding gain advantage is 
more pronounced for long codes with rather high rates. Once again, this can be explained in terms of the spectral 
thinning effect, which provides the rationale of the performance improvement we have found. 
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